Using affine correspondence to estimate 3-D facial pose
نویسندگان
چکیده
We describe a method for tracking a person’s face through an image sequence and estimating the 3-D facial pose within each frame. It is based on an affine approximation to the motion of projected facial features such as eyes, mouth and nose. Tracking stability is maintained by enforcing the affine relationship amongst the motion of the features using linear regression and a Kalman filter. Facial pose is estimated using an ellipse-circle correspondence technique based on the affine transformation between the features in the current view and those in a fronto-parallel view. The method has the advantage of being simple to implement and not relying on assumed facial characteristics.
منابع مشابه
3-D Facial Pose and Gaze Point Estimation Using a Robust Real-Time Tracking Paradigm
Facial pose and gaze point are fundamental to any visually directed human-machine interface. In this paper, we propose a system capable of tracking a face and estimating the 3-D pose and the gaze point all in a real-time video stream of the head. This is done by using a 3-D model together with multiple triplet triangulation of feature positions assuming an affine projection. Using feature-based...
متن کاملModel-Based Facial Image Coding
This paper addresses the issue of 3-D motion estimation in model-based facial image coding. A new approach to estimating the motion of the head and the facial expressions is presented and has the following characteristics: 1) An affine nonrigid motion model is set up. The specific knowledge about facial shape and facial expression is formulated by this model in the form of parameters. This affi...
متن کامل3D Recognition and Pose Estimation Using Model Reconstructed by Pairwise Correspondence
This paper focuses on pose estimation of 3D object from 2D images. The base system of Structure from Motion is applied. A 3D model with feature points and descriptors is prebuilt. 3D-2D matching is employed in recognition and pose estimation process. The method of pairwise correspondence is proposed. To reduce reprojection error of the model, a weighting step is added. Viewpoint change of camer...
متن کاملPose Normalization for Eye Gaze Estimation and Facial Attribute Description from Still Images
Our goal is to obtain an eye gaze estimation and a face description based on attributes (e.g. glasses, beard or thick lips) from still images. An attribute-based face description reflects human vocabulary and is therefore adequate as face description. Head pose and eye gaze play an important role in human interaction and are a key element to extract interaction information from still images. Po...
متن کاملUnsupervised Depth Estimation, 3D Face Rotation and Replacement
We present an unsupervised approach for learning to estimate three dimensional (3D) facial structure from a single image while also predicting 3D viewpoint transformations that match a desired pose and facial geometry. We achieve this by inferring the depth of facial key-points in an input image in an unsupervised way. We show how it is possible to use these depths as intermediate computations ...
متن کامل